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(57) Abstract 



A 3-D ultrasound imaging system for the eye, prostate and other organs, comprising an assembly onto which an ultrasound probe may 
be mounted, a motor and drive for either rotating or scanning the probe relative to the human organ under investigation, and a computer 
for executing proprietary software for controlling movement of the assembly to rotate or scan the probe. Ultrasound signals from the probe 
are processed via a clinical ultrasound machine for generating multiple images of the organ. The proprietary software being executed on 
the computer collects the 2-D ultrasound images of the clinical ultrasound machine and reconstructs these images to form a 3-D display 
which can be viewed and manipulated in real time, or stored for later retrieval. 
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THREE-DIMENSIONAL ULTRASOUND IMAGING SYSTEM 
Field of the Invention 

This invention relates in general to a three- 
dimensional imaging system for scanning animate and 
5 inanimate objects and creating three dimensional (3-D) 
images thereof. In the case of animate objects, the 
system of the present invention may be used for three 
dimensional (3-D) ultrasound imaging of human or animal 
organs such as the eye, prostate, and other organs 
10 suitable for ultrasound imaging. 
Background of the Invention 

Clinical ultrasound diagnostic equipment is well 
known in the medical arts for viewing internal human 
organs. For example, opthamologists and radiologists 
15 often require images of the eye for investigating eye 
maladies and for making volumetric measurements. In 
diagnosing prostate cancer, a diagnostician uses trans- 
rectal ultrasound (TRUS) to identify whether lesions are 
present, and determines the location, size and extent of 
20 the lesions. However, such prior art ultrasound devices 
produce only 2-D images whereas the anatomies under 
investigation are three-dimensional. 

Also, the ultrasound image in prior art 2-D images 
represents a single plane approximately l mm thick and at 
25 an arbitrary angle in the patient's body. Thus, it is 
generally difficult to localize the image plane in the 
organ, and very difficult to reproduce a particular image 
location at some later time. 

Prior art ultrasound imaging systems typically 
3 0 comprise a probe for transmitting ultrasound signals into 
the human body and receiving reflected ultrasound signals 
therefrom, and a clinical ultrasound machine for 
receiving and processing analog ultrasound signals from 
the probe for generating multiple images of the organ. 
35 A number of patents have issued relating to prior 

art probes with internal mechanical sensors. Examples of 
these systems^ are disclosed in the following United 
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States Patents: 5,159,931 (Pini) ; 5,152,294 (MochizuJci 
et al) ; 4,819,650 (Goldstein); 4,841,979 (Dow et al) and 
4,934,370 (Campbell). 

Prior art systems are also known to use encoders for 
5 determining the position of the sensors and transmitting 
that information to a controlling computer. Examples of 
such systems are disclosed in the following United States 
Patents: 5,159,931 (Pini); 5,152,294 (Mochizuki et al) ; 
4,932,414 (Coleman et al) ; 4,271,706 (Ledley) ; 4,341,120 
10 (Anderson); 5,078,145 (Furuhata) ; 5,036,855 (Fry et al) ; 
4,858,613 (Fry et al) and 4,955,365 (Fry et al) . 

Other patents have issued which provide general 
background information on the subject of clinical 
ultrasound imaging systems. United States Patent 
15 5,081,993 (Kitney et al) , discloses an intravascular 

probe for insertion into blood vessels. It incorporates 
an array of crystals surrounding a tube and generates a 
cross-sectional view. United States Patent 4,747,411 
(Ledley) discloses a 3-D imaging system which requires 
2 0 the use of stereo eyeglasses. United States Patent 

4,899,318 ( Schlumberger et al) and United States Patent 
4,028,934 (Sollish) relate to specific methods of 
stereoscopic 3-D visualization of objects. United States 
Patent 3,555,888 discloses a probe having a single 
25 crystal and a mechanical means for moving the single 

crystal. United States Patent 4,564,018 (Hutchison et 
al) discloses an ultrasonic diagnostic scanner for 
producing peak signals and count signals responsive 
generation of the peak signals for identifying a 
30 perceptible eye parameter. United States Patents 
4,594,662; 4,562,540 and 4,598,366 relate to 3-D 
holography. United States Patent 4,866,614 (Tarn) teaches 
the use of a plurality of stationary ultrasound beams 
which are generated on the basis of multiple transducers. 
35 PCT application number PCT/EP92/00410 (Technomed 

International) discloses a treatment probe inserted into 
the urethra and means for rotating and moving the probe 
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up and down on a stand* 

United States Patent 4,932,414 (Coleman) is of 
interest for disclosing an extension of kidney stone 
acoustic shattering techniques, applied to the eye. In 
5 order to see what a surgeon is doing, an ultrasound 

imaging probe is provided for sweeping out a volume of 
the eye resulting in a 3-D impression when the volume is 
swept quickly enough. However, the Colemen Patent does 
not disclose any means for reconstruction of the 3-D 
10 image from the multiplicity of generated 2-D images. 

Furthermore, the system of Coleman et al teaches the use 
of an encoder for determining the position of the probe. 
Summary of the Invention 

According to the present invention, a 3-D ultrasound 
15 imaging system is provided which comprises a universal 
assembly onto which an ultrasound probe may be mounted. 
The assembly incorporates a motor and drive for either 
rotating or scanning the probe relative to the organ 
under investigation. Ultrasound signals from the probe 

2 0 are processed via a clinical ultrasound machine for 

generating multiple images of the organ. A computer is 
provided for executing software for controlling movement 
of the assembly to rotate or scan the probe, and for 
collecting the 2-D ultrasound images from the clinical 
25 ultrasound machine and re-constructing these images to 
form a 3-D display. 

In essence, the present invention may be 
characterized by a novel combination of ultrasound probe, 
clinical ultrasound machine, probe assembly and computer 

3 0 for controlling movement of the probe assembly and 

reconstructing three dimensional images from a plurality 
of two dimensional images obtained from the clinical 
ultrasound machine. A unique advantage of the present 
invention is that it is adaptable to any prior art and 
35 manufacture of probe, thereby alleviating the prior art 

requirement for sophisticated probes with internal moving 
sensors, etc. 
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Brief Description of the Drawin g 

A detailed description of the preferred and 
alternative embodiments is provided hereinbelow with 
reference to the following drawings, in which: 

Figure l illustrates the configuration of a 3-D 
ultrasound imaging system according to the present 
invention ; 

Figure 2 is a perspective view of an assembly for 
mounting a conventional ultrasound probe for scanning the 
human eye or other organs, according to a first 
embodiment of the invention; 

Figure 3 is a side view of the assembly shown in 
Figure 2; 

Figure 4 is a detailed perspective view of the 
15 assembly shown in Figures 2 and 3; 

Figure 5 is a perspective view (partly broken) of an 
assembly for rotating an end-firing ultrasound probe 
using axial rotation, according to a second embodiment of 
the present invention; 
20 Figure 6 is a side cross-sectional view of the 

assembly shown in Figure 5; 

Figure 7 is a perspective view (partly broken) of an 
assembly for moving side-firing ultrasound probe using 
sector rotation, according to a third embodiment of the 
25 present invention; 

Figure 8A is a perspective view (partly broken) of a 
further assembly for moving an ultrasound probe via 
lateral translation, according to a fourth embodiment of 
the invention; 

30 Figure 8B is a side cross-sectional view of the 

assembly shown in Figure 8 A; 

Figure 9 is a further embodiment of ultrasound probe 
assembly for rotating the probe via axial rotation; 

Figures 10A-10D illustrate various geometries of 
3 5 probe sweeping movements for imaging the eye, according 
the various embodiments of ultrasound probe assemblies; 
Figure 11 is block diagram showing functional 
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interconnection of various software modules of the 
present invention; 

Figure 12 is a flow chart showing operation of the 
3-D ultrasound imaging system of the present invention; 
5 Figure 13 is a flow chart showing details of the 

reconstruction and viewing steps of operating the 3-D 
imaging system of the present invention; 

Figure 14 is a flow chart showing details of 3-D 
image reconstruction according to the preferred 
10 embodiment; Figure 15 is a flow chart showing details 
of the pixel mapping steps of the reconstruction process 
illustrated in Figure 14; 

Figures 16A and 16B are reconstruction diagrams 
showing transformation of an input image captured by 
15 axial rotation and sector rotation, respectively; 

Figure 17 is a reconstruction diagram schematically 
representing a temporary raster; 

Figures 18A and 18B are reconstruction diagrams 
showing the computation of the contents of the temporary 
20 raster for an image captured by axial rotation; 

Figures 19A and 19B are reconstruction diagrams 
showing computation of the contents of the temporary 
raster for sector rotation; 

Figures 2 OA and 2 OB are reconstruction diagrams 
25 showing the creation of a list of contributing pixels in 
the temporary raster for an image captured by axial 
rotation; 

Figures 21A and 2 IB are reconstruction diagrams 
showing the creation of a list of contributing pixels in 
3 0 the temporary raster for an image captured by sector 
rotation ; 

Figure 22 is a reconstruction diagram showing 
extraction of a slice of a resultant image; and 

Figure 23 is a reconstruction diagram showing the 
35 storage of the contents of the temporary raster in an 

array of output pixels forming a reconstructed 3-D image. 
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Detailed Description of the Preferr ed Embodiment 

With reference to Figure 1, the overall 
configuration is illustrated of the 3-D ultrasound 
imaging system of the present invention. A conventional 
5 ultrasound probe 1 is rotated by means of a probe holder 
3 which forms part of an assembly 5. The assembly 5 also 
includes a motor and output shaft for moving the holder 3 
and associated probe 1 through a predetermined angular 
sweep for generating a plurality of images of an organ 

10 (not shown) under examination. It is contemplated that 
the system of the present invention may be used to 
provide 3-D ultrasound images of the eye, prostate, 
female breast, heart, arteries and veins, kidney, liver, 
and other organs suitable for ultrasound imaging. The 

15 signals from probe 1 are transmitted via a communication 
line 7 for processing by a conventional clinical 
ultrasound machine 9. The processed multiple images are 
transmitted via a communication line 10 from ultrasound 
machine 9 to a computer 11 which typically incorporates a 

20 video-based digitizer (not shown) . The series of 2-D 

images from ultrasound machine 9 are then reconstructed 
in computer 11 into a single 3-D image for interactive 
manipulation and display, or into a sequence of 3-D 
images. The computer 11 also generates control signals 

25 to a motor driver 13 via line 12, which in response 
generates further control signals along line 14 for 
controlling operation of the assembly 5 to sweep the 
probe l. 

As discussed above, according to one embodiment of 
30 the invention, images of the human eye are scanned and 
reconstructed in the computer 11. With reference to 
Figure 2, an assembly 5 is shown comprising a head 
support platform 15 for supporting the head of a patient 
P. A base plate 17 is connected to the supporting 
35 platform 15. The horizontal and angular position of the 
plate 17 may be adjusted by means of the adjustment knob 
19 which is threaded to a bolt (not shown) passing 
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through an adjustment slot 21 in the base plate 17. A 
vertical adjustment member 23 houses a threaded rod 25 to 
which is connected an adjustment knob 27 at a top end of 
the vertical adjustment member 23 (see Figures 3 and 4) . 
5 A bracket 29 is connected to vertical adjustment member 
23 and has an internal threaded hole through which the 
adjustment bolt 2 5 passes, such that the height of the 
bracket 29 may be adjusted by rotating the knob 27. 

A motor 31 is mounted in a motor box 3 3 which, in 

10 turn, is connected to the bracket 29. The motor 31 
typically comprises a stepper motor along with gear 
reduction wheels 35 and 37, and an output shaft 39. An 
offset arm 41 is connected to the output shaft 39 at one 
end, while the opposite end of the offset arm 41 is 

15 connected to probe holder 3. 

In operation, the pivoting offset arm 41 is 
positioned so that the probe 1 is placed firmly via a 
coupling gel (see Figure 10) adjacent the eye of the 
patient P. Once a desired scan region has been chosen, 

20 the motor 31 is actuated thereby causing the arm 41 to 
sweep across a scanning region while the probe 1 scans 
the eye to obtain a sequence of images. As discussed in 
greater detail below, the sequence of images is digitized 
rapidly and stored in computer 11 (Figure 1) . 

25 Preferably, approximately 100 images are collected in a 
single sweep of approximately 10 second duration, 
covering a probe scanning angle of approximately 30° (see 
Figure 3). The collected images are then reconstructed 
to form a 3-D volumetric representation of the eye which 

30 can then be viewed and manipulated in "real time", either 
on the monitor of computer 11 or a remote monitor, for 
diagnostic purposes. As discussed in greater detail 
below with reference Figures 10A and 10B, the embodiment 
of Figures 2-4 sweeps out a 3-D volume of the eye which 

35 is in the shape of a sector of a cylinder. 

Turning to Figures 5 and 6, an alternative 
embodiment of assembly is shown for axially rotating an 



10 



WO 96/00402 PCT/CA94/00355 



end-firing ultrasound probe 51. Thus, the image volume 
swept out by the probe 51 in the embodiment of Figure 5 
is generally conical, rather than being in the shape of a 
sector as in the case of the embodiment in Figures 2-4. 
The assembly 53 comprises an external housing which 
contains a motor 57 with an output shaft 59 extending 
from one end. The probe 51 is held securely by a barrel 
60 supported by a pair of ball bearing mounts 61 and 63. 
Gear reduction wheels 65 and 67 are connected to the 
output shaft 59 and barrel 60, respectively, and a belt 
69 translates rotary motion of the output shaft 59 to a 
similar (but gear reduced) rotation of the barrel 60 and 
consequently also of the probe 51 in a reciprocating 
circular motion in either direction as illustrated by the 
15 arrow A. 

The axially rotating embodiment of Figures 5 and 6 
may be useful for scanning internal organs such as the 
prostate. 

With reference to the embodiment of Figure 7, an 
assembly is shown for rotating a side-firing ultrasound 
probe 70. Thus, the image volume is swept out by the 
probe 70 in the embodiment of Figure 7 is generally in 
the shape of a sector, rather than being conical as in 
the embodiment of Figures 5 and 6. The assembly 71 
25 comprises a probe rotator 72 and motor 73 having an 

output shaft 74 extending from one end. The probe 70 is 
held securely by a barrel 75 supported by a pair of ball 
bearing mounts 76 and 77. Gear reduction wheels 78 and 
79 are connected to the output shaft 74 and barrel 75, 
respectively, and a belt 80 translate rotary motion of 
the output shaft 74 to a similar (but gear reduced) 
rotation of the barrel 75 and consequently also of the 
probe 70 in a circular motion both clockwise and 
counterclockwise . 
35 The embodiment of Figure 7 is also useful for 

scanning internal organs such as the prostate. 

Turning now to the alternative embodiment of Figures 
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8 A and 8B, an assembly 80 is shown comprising a motor 81 
within a housing 82. The motor 81 includes gear 
reduction wheels, belts, etc., which cause a threaded 
output shaft 83 thereof, to rotate. An I-blocJc 84 is 
5 mounted to the output shaft 8 3 via an internal threaded 
hole so that the I-block 84 moves according to a linear 
motion in either direction, as represented by the arrow 
in Figure 8A. The holder 3 for probe 1 is connected to 
I-block 84 via screws 85 and 86. The angle of 
10 inclination of the probe 1 relative to the direction of 
movement, is adjustable via the screw 86. 

As shown in Figure 8B, the assembly of Figures 8A 
and 8B may be used to collect images of an internal organ 
or lesions such as breast tumors within the trunk of the 
15 patient P, there being shown a layer of coupling gel 87 
intermediate the probe 1 and the patient P. 

Turning to yet another alternative embodiment of 
assembly illustrated in Figure. 9, an ultrasound probe 91 
is shown for trans-esophageal imaging of the heart. The 
20 probe 91 is mounted within an annular gear-toothed wheel 
93 which, in turn, engages a further gear reduction wheel 
95 connected to a motor 97 via an output shaft 99 
thereof. Upon rotating the output shaft under control of 
the motor 97, gear wheels 95 and 93 rotate, which causes 
55 the ultrasound probe 91 to rotate in consequence. 

Although five embodiments of assembly have been 
illustrated, for diagnostic investigation of the eye, 
prostate, heart, breast and other internal organs, it is 
contemplated that additional assemblies may be designed 
10 for clinical evaluation of female breasts, the heart, 

etc. All such embodiments are believed to be within the 
sphere and scope of the present invention. 

Turning to Figures 10A-10D, various scanning 
geometries are illustrated. In Figure 10A, the sweeping 
15 motion of probe 1 results in a plurality of 2-D images of 
the eye E conforming to a fan of planes. In Figure 10B, 
the probe 1 is separated from the eye E by an acoustic 
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window of gel G such that a fan of two dimensional images 
is collected wherein the axis of rotation is behind the 
eye E. The probe rotation mode represented by Figures 
10A and 10B is referred to herein as "sector" rotation. 
5 In Figures IOC and 10D, the axis of rotation is 

longitudinal so as to provide 180° rotation of the probe 
1. The probe rotation mode represented by Figures IOC 
and 10D is referred to herein as "axial" rotation. 

The method of reconstructing 3-D images for the 
10 geometries of Figures 10A-10D is discussed in greater 
detail below with reference to Figures 14-23. However, 
reference is made firstly to the block diagram of Figure 
11 which shows the overall system functionality of the 
present invention. A user interface 1101 is provided in 
15 the form of a mouse, keyboard or other input to the 
computer 11 (Figure 1) and software. The software 
operating within the computer 11 is divided into various 
functional modules, as follows: ultrasound scanning 
module 1103, volume reconstruction module 1105 and volume 
20 viewing module 1107. in the case of ultrasound scanning 
1103, commands 1109 may be sent to control the probe 
assembly, (e.g. assembly 5 in Figures 2-4, assembly 53 in 
Figures 5 and 6, or assembly 71 in Figures 7 and 8 via 
the motor driver 13 (Figure l) ) . a succession of 2-D 
25 images from the ultrasound probe 1 are transmitted from 
clinical ultrasound machine 9 via line 10 as an input 
1111 to the ultrasound scanning module 1103. These 
analog images are digitized via the ultrasound scanning 
module 1103 and stored in a computer memory 1113. 
3 0 Computer memory 1113 can then store the digitized 2-D 

images via image data transfer in a file storage device 
1115, or, upon receipt of an appropriate user command 
from interface 1101, the 2-D images may be reconstructed 
via volume reconstruction software module 1105, as 
35 discussed in greater detail below. Once the 3-D image 
has been reconstructed in module 1105 and stored in 
computer memory 1113, upon receipt of appropriate user 
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commands from user interface 1101, the volume viewer 
module 1107 manipulates the view perspective of the 
reconstructed 3-D image for output to a monitor (output 
to monitor module 1117). 
5 According to the preferred embodiment, motor 31 

(Figure 4), 57 (Figure 5) , 73 (Figure 7), 81 (Figures 8A 
and 8B) and 97 (Figure 9) are precision motors which 
rotate their respective shafts with constant angular 
increment or velocity. Thus, when the 2-D images are 
10 acquired, they are equally spaced (i.e. either with 
constant angular intervals when sector or axial 
geometries are implemented, or with constant distance in 
the case of a linear geometry) . In some cases the 
selected motor may include an internal position encoder 
15 to ensure shaft rotation at a constant angular velocity. 
One example of such a preferred motor is the Model C57-51 
stepper motor manufactured by Compumotor (division of 
Parker Corporation) . 

Turning now to Figure 12, upon starting a typical 
20 3-D ultrasound imaging procedure (start step 1201), the 
probe 1 is inserted into the scanner assembly (step 
1203), the anatomy to be scanned is located (step 1205), 
and an image of the anatomy is placed in an ROI frame 
(step 1207) . The ROI frame is a frame drawn on the 
25 output monitor by a frame grabber program executed by 
computer 11, where ROI represent an area of interest. 
Next, the user confirms the anatomy coverage by manual 
scan control (step 12 09) . If the anatomy is outside of 
the ROI frame, then operation returns to step 1207, 
30 otherwise, (step 1211) the operation proceeds to step 
1213 wherein the user fixes or holds the probe scanner 
assembly in place. Next, in step 1215, a volume of image 
is acquired and the user may review the acquired frames 
in step 1217. If the data has been acquired incorrectly 
35 (step 1219), the process control returns to step 1205. 

Otherwise, process control proceeds to step 1221 in which 
the acquired volume is saved and stored to computer 
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memory as a stack of 2-D images I (x,y,z) , (see 1113 of 
Figure 11) . Next, the steps of reconstruction and 
viewing of the 3-D image are effected (step 1223 is 
discussed in greater detail below with reference to 
5 Figures 14-23). If the user wishes to perform another 3- 
D scan (step 1225) , the process control returns to step 
12 05. Otherwise, the procedure is exited (step 1227) . 

The steps for utilizing the reconstruction and 
viewing algorithm discussed in greater detail below with 
10 reference to Figures 14-23, are shown in Figure 13, 

beginning with a start step 13 01. If the user does not 
wish to reconstruct a 3-D image (step 13 03), then the 
user merely exits the system (step 1313). Otherwise, the 
system reconstructs the 3-D image (step 1305), and saves 
15 the reconstructed image to computer memory (step 1307) . 
The user is then given the opportunity to view the 3-D 
image (step 1309) . if the user does not elect to view 
the 3-D image, then process control returns to set 1303. 
However, if the user wishes to view the captured and 
reconstructed 3-D image, then the image is viewed and if 
required image slices may be extracted (step 1311). 
After viewing the 3-D image, the procedure is exited 
(step 1313) . 

Turning now to Figures 14-23, the 3-D image 
25 reconstruction algorithm of module 1105 (Figure 11) is 
discussed in greater detail. After initializing the 
module (step 1401), the stack of 2-D images I(x,y,z) is 
retrieved from computer memory 1113 (step 1403) . The 
stack of images I(x,y,z) is transformed into a resultant 
30 image R(x,y,z) . For axial rotation reconstruction (i.e. 
the embodiment of Figures 10C and 10D) , the 
transformation function is f: (x,y,z)-*(x, z,y) . For 
sector reconstruction, the transformation is effected by 
(x*Y,z)^(z,y,C-x) , where C is the x-dimension 
35 I(x,y,z)-1. 

Considering the transformation of I(x,y,z) to 
&(x,Y,z) for sector reconstruction, in order to access a 
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vertical line of the image stored in computer memory 
1113, the transformation is effected as shown in Figure 
16B to provide easy access to each vertical line of each 
image slice. The most efficient procedure for accessing 
5 each vertical line of the image is to do so on the zy- 
plane. Hence, as shown in Figure 16B, the image is 
rotated so that 2-D images on the yz -plane are 
transformed to the xy-plane. 

With respect to axial rotation (Figure 16A) , the 

10 same geometry of 2-D images is originally stored in 

computer memory 1113, except that instead of accessing 
vertical lines, for 3-D reconstruction the system 
captures horizontal lines. The horizontal 2-D image 
"slices" are accessed from top-to-bottom of the 3D volume 

15 rather than from front-to-back, to provide greater speed 
of image reconstruction with the fewest number of 
calculations . 

The transformations of step 1405 are conducted on a 
pixel-by-pixel basis, utilizing known methodologies. 

20 In step 1407, a temporary raster T(x,y) is created 

which must be large enough to store a z -slice of the 
reconstructed image. Figure 17 shows a temporary raster 
T(x,y) comprising a plurality of grid points or pixels 
1701. The temporary raster T(x,y) is used to hold a 

25 single z-slice of the reconstructed image, which is 
represented by a 3-D array V(x,y,z) . 

Upon creating the temporary raster T(x,y) all 
computer calculations are performed on the x,y-plane 
(i.e. on individual z-slices of the image) . The 

30 temporary raster T(x,y) must be created to sufficiently 
large dimensions to accommodate the creation of bigger 
images in axial rotation geometries. For each pixel in 
the temporary raster T(x,y) the module must find the 
exact coordinate in the original slice of the resultant 

35 image R(x,y,z) (i.e. the exact color or grey level must 
be computed for each pixel in T from R) . 

In step 1409, for each pixel p(x,y) in T(x,y) a list 
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L(x,y) of contributing pixels is computed in the source 
image from which each such pixel receives a gray level, 
discussed in greater detail below with reference to 
Figure 15. Figures ISA and 18B shown computation of the 
5 contents of temporary raster T(x,y) from a z-slice of the 
resultant image R(x,y,z,), wherein the x-dimension of 
A(x,y) is n ,. For axial rotation, the geometry is such 
that there is a line which rotates according to a 
circular path to compute the original location for a 
10 pixel T, therefor the use of polar coordinates is 

adopted, starting from the origin, the radial distance 
"r" from the pixel and the angle "a" are computed. After 
"r« and "a" are computed, indexing is used for each image 
slice in J? since the location of the first horizontal 
15 line of the image is known. By using the angle "a" the 
module computes where the pixel should be located in R. 
Once the location of the pixel has been computed, one of 
either a "nearest neighbor algorithm" or an averaging 
algorithm or weighting function are used to approximate 
the appropriate gray-level for the pixel. The arrow A in 
Figure 18B shows the direction with which the original 
images in I(x,y,z) were captured. 

Figures 19A and 19B show the computation of contents 
of the temporary raster T(x,y) from A(x,y) for sector 
25 reconstruction. 

For sector rotation, the geometry is similar to that 
of axial rotation except that the axis of rotation is 
outside of the image, as discussed above with reference 
to axial reconstruction, the angular displacement and 

30 distance of each pixel is computed from the first line of 
the image. However, a smaller value of »r" is used in 
sector reconstruction than the actual distance from the 
Pixel to the axis of rotation since there is no need to 
extend the radius all of the way back to the axis of 

35 rotation. Using well known linear algebra techniques, 
the vector established by the calculated polar 
coordinates can be transformed to have the same origin 
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(i.e. it is possible to ignore the axis of rotation 
outside of the image volume) . 

As shown in Figures 20A, 20B, 21A and 21B, the list 
L of p(x 0 ,Yo) may contain some or all of the pixels 
neighbors in A(x,y) , depending on the scheme adopted 
(i.e. nearest neighbor, averaging or interpolation of 
neighbors) . In step 1411, the module queries whether all 
z -si ices of the final 3-D image V(x,y,z) have been 
constructed. if the answer to the query is no, then a 
new z-slice A(x,y) is extracted from the resultant image 
R(x,y,z) and the grey level or color of each pixel T(x,y) 
from A(x,y) is computed according to the L list of that 
pixel by means of nearest neighbor, or averaging or 
interpolation of neighbor pixels (step 1417) . 

Once the list of neighbors has been computed for 
each pixel T, then the entire 3-D volume can be 
reconstructed. In particular, each slice in R is 
accessed and reconstruction is executed, one slice at a 
time according to the list of neighbors L. After finding 
the exact location of the pixel R, the list L of 
contributing pixels is computed. In Figures 20A and 21A, 
the location of the pixels is shown for axial rotation 
and sector rotation, respectively. Indexing is then 
performed to revert to the individual z-slice of R 
(referred to as A) , which changes the geometry back to a 
rectangularly shaped image (Figures 2 OB and 2 IB) . At 
this stage, all four neighbors of the pixel are accessed 
to determine the appropriate grey- level or color for the 
selected pixel of T(x,y) . 

In Figure 22, the z-slice A(x,y) of R(x,y,z) is 
extracted and the computation of step 1417 is effected to 
compute all values of the plane that are contributed by 
the resultant image R(x,y,z) for storage into the final 
volume. After finishing all slices of R(x,y,z) , the 
reconstruction is complete and the contents of T(x,y) are 
stored in the final 3-D image V(x,y,z) . 

Steps 1411-1419 are re-executed until all z-slices 
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of the final 3-D image have been reconstructed, after 
which the module is exited (step 1413). 

Turning briefly to Figure 15, the pixel mapping step 
14 09 is shown in greater detail as a sub-module. 

The module is initiated at step 1501, following 
which the procedure queries whether all pixels of the 
temporary raster T(x,y) has been processed (step 1503). 

If not, a pixel p(x,y) of the temporary raster 
T(x,y) is retrieved in step 1505. A mapping from p(x,y) 
to polar coordinates p'fr,a; is computed in step 1507 
using the techniques discussed above with reference to 
Figures 18A, 18B, 19A and 19B. 

Next, a list L(x,y) is created of the contributing 
pixels in the source image according to p' (r,a) (step 
15 1509) . The creation of this list is shown with reference 
to Figures 20A and 20B for axial rotation and 21A and 21B 
for sector reconstruction. 

The list L(x,y) is then stored at step 1511 and 
process control is returned to the query of step 1503. 
Once all pixels of the temporary raster T(x,y) have been 
processed, the sub-module is exited at step 1513. 

As discussed above, once the reconstruction has been 
completed and the reconstructed image array V(x,y,z) has 
been stored in computer memory 1113, the image may be 
viewed and manipulated in a well known manner utilizing 
volume viewer module 1107 (Figure 11) (e.g. Analyze™). 

Although the volume reconstruction technique has 
been described in an ultrasound 3-D imaging system having 
an ultrasound probe which is moveable to scan the target, 
it should be apparent to those of skill in the art that 
the volume reconstruction technique may be used in 
conjunction with 3-D imaging systems using a different 
type of ultrasound imaging probe and/or sweep geometry to 
acquire the 2-D images. Moreover, it should also be 
realized that the volume reconstruction technique is not 
limited to ultrasound imaging but may also be used in 
different environments where a 3-D image of a target 
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needs to be generated from a succession of 2-D images. 

In addition, although the system has been described 
as including a clinical ultrasound machine and a 
computer, it is contemplated that a single machine 
5 performing the functions of both of these components be 
used . 

Other embodiments and modifications of the invention 
are possible within the sphere and scope defined by the 
claims appended hereto. 
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I CLAIM 

1. A three-dimensional ultrasound system for use with 
an ultrasound probe connected to a clinical ultrasound 
5 machine and a computer for storing a succession of two- 
dimensional images generated by said clinical ultrasound 
machine represented by an array of pixels I(x,y,z,) , 
responsive to movement of said probe, the system 
comprising: 

10 a) an assembly for mounting said probe adjacent an 

organ to be examined and for moving said assembly such 
that said probe scans said organ to be examined, thereby 
resulting in generation of said succession of two- 
dimensional images by said clinical ultrasound machine 

15 and storage in said computer of said images represented 
by said array of pixels I(x,y,z,); and 

b) controller means in said computer for (i) 
controlling movement of said assembly such that said 
probe sweeps out a predetermined volume of said organ to 

20 be examined and (ii) reconstructing said two-dimensional 
images represented by said array of pixels I(x,y,z,) to 
form a reconstructed three-dimensional image represented 
by an array of output pixels V(x,y,z,) . 

25 2. The three-dimensional ultrasound system of claim 1, 
wherein said assembly further includes: 

c) motor means having an output shaft which rotates 
about an axis of rotation thereof under control of said 
controller means; and 

30 d ) adapter means for mounting said probe at a 

predetermined position relative to said axis of rotation 
such that said probe sweeps out said predetermined volume 
of said organ to be examined upon rotation of said output 
shaft. 



35 



3. The three-dimensional ultrasound system of claim 2, 
wherein adapter means is connected to said output shaft 
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in parallel with said axis of rotation such that said 
predetermined volume is a cylinder, 

4. The three-dimensional ultrasound system of claim 2, 
wherein said adapter means is connected to said output 
shaft orthogonally to said axis of rotation such that 
said predetermined volume is a cylindrical sector. 

5. The three-dimensional ultrasound system of claim 2, 
wherein said adapter means is connected to said output 
shaft for longitudinal translation thereon, such that 
said predetermined volume is a parallelepiped. 

6. The three-dimensional ultrasound system of claim 3, 
wherein said controller means further comprises: 

e) means for transforming said array I(x,y,z) into a 
resultant array R(x,y,z) according to the transformation 
f: (x,y,z)->(x,z,y) ; 

f) means for creating a temporary raster T(x,y, ) for 
storing a single z-slice of said reconstructed three- 
dimensional image; 

g) means for computing a list L of contributing 
pixels from a z-slice A(x,y) of the resultant array 
R(x,y,z,) for each pixel p(x,y) in T(x,y) , and in 
response storing said list L; 

h) means for extracting successive z -si ices A(x,y) 
of said resultant array R(x,y,z) ; 

i) means for computing one of either a gray- level or 
color for each pixel p(x,y) in T(x,y) from A(x,y) 
according to the list L for each said pixel p(x,y) and 
storing said one of either gray-level or color for each 
said pixel p(x f y) in said temporary raster T(x,y); and 

h) means for storing the contents of said temporary 
raster T(x,y) in said array of output pixels V(x,y,z) • 

7. The three-dimensional ultrasound system of claim 6, 
wherein said means for computing said list L further 
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comprises: 

j) means for retrieving each said pixel p(x,y) ; 

k) means for converting p(x,y) to a polar coordinate 
P'(r,a); 

1) means for creating said list L of contributing 
pixels according to p' (r,a) ; and 
m) means for storing X. 

8. The three-dimensional ultrasound system of claim 6, 
wherein said means for computing said gray-level further 
comprises one of either means for averaging, means for 
interpolating or means for selecting a nearest one of 
said contributing pixels to each said pixel p(x,y) . 

15 9. The three-dimensional ultrasound system of claim 4, 
wherein said controller means further comprises: 

e) means for transforming said array I(x,y,z) into a 
resultant array R(x,y,z) according to the transformation 
£: (x,Y,z)->(z,y,c-x) , where c is the x dimension of 

20 I(x,y,z) minus l; 

f) means for creating a temporary raster T(x,y) for 
storing a single z-slice of said reconstructed three- 
dimensional image; 

g) means for computing a list L of contributing 
pixels from a z-slice A(x,y) of the resultant array 
R(x,y,z) for each pixel p(x,y) in T(x,y) , and in response 
storing said list X; 

h) means for extracting successive z-slices A(x,y) 
of said resultant array R(x,y,z); 

i) means for computing one of either a gray-level or 
color for each pixel p(x,y) in T(x,y) from A(x,y) 
according to the list L for each said pixel p(x,y) and 
storing said one of either gray-level or color for each 
said pixel p(x,y) in said temporary raster T(x,y) ; and 

h) means for storing the contents of said temporary 
raster T(x,y) in said array of output pixels V(x,y,z). 
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10. The three-dimensional ultrasound system of claim 9, 
wherein said means for computing said list L further 
comprises: 

j) means for retrieving each said pixel p(x,y) ; 
k) means for converting p(x,y) to a polar coordinate 
P' (r,a) ; 

1) means for creating said list L of contributing 
pixels according to p' (r,a) ; and 
m) means for storing I*. 

11. The three-dimensional ultrasound system of claim 9, 
wherein said means for computing said gray- level further 
comprises one of either means for averaging, means for 
interpolating or means for selecting a nearest one of 
said contributing pixels to each said pixel p(x,y) . 

12. The three-dimensional ultrasound system of claim 1 
wherein said organ is an eye. 

20 13. The three-dimensional ultrasound system of claim 1 
wherein said organ is a prostate. 

14 . The three-dimensional ultrasound system of claim 1 
wherein said organ is a female breast. 

25 

15. The three-dimensional ultrasound system of claim l 
wherein said organ is a heart* 

16. The three-dimensional ultrasound system of claim 1 
3 0 wherein said organ comprises arteries and veins. 

17. The three-dimensional ultrasound system of claim 1 
wherein said organ is a kidney. 

35 18. The three-dimensional ultrasound system of claim 1 
wherein said organ is a liver. 
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19. A method for converting a succession of two- 
dimensional images of a target volume represented by an 
array of pixels I(,x,y,z) i nto a three-dimensional image 
represented by a volumetric image array V(x,y,z) 
5 comprising the steps of: 

(i) transforming said array of pixels I(x,y,z) into 

an image array R(x,y r z) so that each z-slice A(x,y) of 
image array R(x,y,z) provides sufficient image data to 
construct an image slice; 
10 (ii) extracting a z-slice A(x,y) of image array 

R(x,y,z) and computing the position of each pixel of 
z-slice A(x,y) in a volumetric image array V(x,y,z); 

(iii) mapping a gray-level or color of the pixels of 
z-slice A(x,y) into corresponding pixels of said 

15 volumetric image array; and 

(iv) repeating steps (ii) and (iii) until all 
z-slices A(x, y) of image array R(x,y,z) have been 
processed to complete said volumetric image array. 

20 20. A system for converting a succession of two- 
dimensional images of a target volume represented by an 
array of pixels I(x,y,z) into a three-dimensional image 
represented by a volumetric image array V(x,y,z) 
comprising: 

means to transform said array of pixels l(x,y,z) 
into an image array R(x t y,z) so that each z-slice A(x,y) 
of image array R(x,y,z) provides sufficient image data to 
construct an image slice; 

means to extract each z-slice A(x,y) of image array 
R(x,y,z) and compute the position of each pixel of each 
z-slice A(x,y) in a volumetric image array; 

means to compute and store a gray-level or color for 
each of the pixels of each z-slice A(x,y) ; and 

means to map the computed gray-levels or colors into 
corresponding pixels of said volumetric image array 
V(x,y,z) . 
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21. A three-dimensional imaging system for acquiring a 
succession of two-dimensional images of a target volume 
represented by an array of pixels I(x,y,z) into a three- 
dimensional image represented by a volumetric image array 
5 V(x,y,z) comprising: 

means to scan said target volume and generate a 
succession of two-dimensional images thereof; and 

processing means in communication with said scanning 
means, said processing means including: 
10 means to convert the succession of two-dimensional 

images of the target volume into an array of pixels 
I(x,y,z) ; 

means to transform said array of pixels l(x,y,z) 
into an image array R(x,y,z) so that each z-slice A(x,y) 
15 of image array R(x,y,z) provides sufficient image data to 
construct an image slice; 

means to extract each z-slice A(x,y) of image array 
R(x,y,z) and compute the position of each pixel of each 
2 -slice A(x,y) in a volumetric image array; 
20 means to compute and store a gray level or color for 

each of the pixels of each z-slice A(x,y) ; and 

means to map the computed gray- levels or colors into 
corresponding pixels of said volumetric image array 
V(x,y,z). 

25 

22. A three-dimensional imaging system as defined in 
claim 21 wherein said scanning means includes an 
ultrasound probe moveable to scan said target volume and 
a clinical ultrasound machine connected to said 
30 ultrasound probe to generate said succession of two- 
dimensional images. 
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